Some Specialized Comparison Techniques for Doubly Stochastic Finite Markov Chains
نویسنده
چکیده
This paper considers certain comparison techniques involving Markov chains with transition matrices Pa = aI+(1?a)P where P is the transition matrix of a doubly stochastic Markov chain. This paper provides upper bounds for how far the Markov chain with transition matrix Pb is from uniformly distributed after n steps. These upper bounds involve how far the Markov chain with transition matrix Pa is from uniformly distributed after m steps and probabilities involving binomial random variables, m, n, a, and b. These upper bounds are provided for cases where b > a and for cases where b < a. The paper also provides an example involving random walks on nite groups where the result in the case b < a is useful.
منابع مشابه
Stochastic Comparison approach for Stochastic Model Checking
Stochastic model checking requires the computation of steady-state or transient distribution for finite or infinite Markov chains for the evaluation of some formulas implying probabilities. However the numerical analysis of Markov chains is much less efficient than the sophisticated algorithmic techniques such as MTBDD developed for the deterministic model checking. We propose to simplify the n...
متن کاملRelative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain
In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...
متن کاملA class of quasigroups solving a problem of ergodic theory
A pointed quasigroup is said to be semicentral if it is principally isotopic to a group via a permutation on one side and a group automorphism on the other. Convex combinations of permutation matrices given by the one-sided multiplications in a semicentral quasigroup then yield doubly stochastic transition matrices of finite Markov chains in which the entropic behaviour at any time is independe...
متن کاملStochastic Dynamic Programming with Markov Chains for Optimal Sustainable Control of the Forest Sector with Continuous Cover Forestry
We present a stochastic dynamic programming approach with Markov chains for optimal control of the forest sector. The forest is managed via continuous cover forestry and the complete system is sustainable. Forest industry production, logistic solutions and harvest levels are optimized based on the sequentially revealed states of the markets. Adaptive full system optimization is necessary for co...
متن کاملENTROPY FOR DTMC SIS EPIDEMIC MODEL
In this paper at rst, a history of mathematical models is given.Next, some basic information about random variables, stochastic processesand Markov chains is introduced. As follows, the entropy for a discrete timeMarkov process is mentioned. After that, the entropy for SIS stochastic modelsis computed, and it is proved that an epidemic will be disappeared after a longtime.
متن کامل